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ABSTRACT 


A  warship  at  sea  requires  awareness  of  the  ships  in  its  vicinity  in  order  to 
operate  safely.  This  can  be  a  daunting  task,  even  when  equipped  with  multiple 
shipboard  systems.  If  naval  air  assets  are  available,  a  Tactical  Action  Officer 
(TAO)  directs  them  to  gain  additional  information  about  as  many  surface 
Contacts  of  Interest  (COI)  as  possible.  These  air  asset  routes  can  be  inefficient 
because  there  are  no  shipboard  systems  to  aid  with  route  planning.  Additional 
complications  include  COIs  moving  during  a  route  and  some  COIs  being  more 
important  to  visit  than  others.  This  thesis  formulates  and  implements  two  Optimal 
Routing  of  Coordinated  Aircraft  (ORCA)  Integer  Linear  Programs  (ILP)  to  plan  air 
asset  routes  that  visit  as  many  prioritized  COIs  as  possible  in  a  fixed  time 
horizon.  We  report  computation  results  planning  for  up  to  four  air  assets  and  up 
to  80  COIs.  Solution  time  for  both  ILPs  is  less  than  half  an  hour  for  typically 
encountered  routing  scenarios  with  less  than  40  COIs.  For  80  COIs,  we  find 
solutions  in  less  than  two  minutes  to  visit  61  COIs,  or  up  to  77  if  we  can  wait  two 
hours  to  obtain  the  solution. 
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EXECUTIVE  SUMMARY 


A  warship  at  sea  requires  awareness  of  the  ships  in  its  vicinity  in  order  to 
operate  safely.  At  times,  this  can  be  a  daunting  task,  even  when  equipped  with 
multiple  shipboard  systems.  If  naval  air  assets  are  available,  a  Tactical  Action 
Officer  (TAO)  directs  them  to  gain  additional  information  about  as  many  surface 
Contacts  of  Interest  (COIs)  as  possible.  These  air  asset  routes  can  be  inefficient 
because  there  are  no  shipboard  systems  to  aid  with  route  planning.  Additional 
complications  include  COIs  moving  during  a  route,  and  some  COIs  being  more 
important  to  visit  than  others. 

This  thesis  formulates  and  implements  two  Optimal  Routing  of 
Coordinated  Aircraft  (ORCA)  Integer  Linear  Programs  (ILPs)  to  plan  air  asset 
routes  that  visit  as  many  prioritized  COIs  as  possible  in  a  fixed  time  horizon.  The 
ORCA  VT  formulation  uses  a  continuous  time  variable  to  model  each  COI  with 
multiple  nodes,  where  each  node  has  a  time  window  when  it  can  be  visited.  The 
ORCA  Tl  formulation  uses  binary  variables  with  a  finite  set  of  time  indexes  to 
construct  routes. 

There  is  a  rich  and  extensive  body  of  literature  presenting  formulations 
and  solution  techniques  for  applications  similar  to  ORCA,  but  we  find  no 
previously  published  research  that  directly  addresses  the  application  we  consider 
in  this  thesis.  The  ORCA  VT  formulation  is  an  applied  case  of  the  Orienteering 
Problem  (OP),  while  the  ORCA  Tl  formulation  follows  the  structure  of  a  time 
dependent  Traveling  Salesman  Problem  (TSP),  or  a  time  dependent  Vehicle 
Routing  Problem  (VRP).  Since  we  consider  multiple  air  assets,  it  becomes  a 
multiple  time  dependent  TSP  if  the  air  assets’  endurances  are  big  enough  to  visit 
all  COIs,  or  a  multiple  time  dependent  VRP  application  otherwise. 

We  use  a  real  data  set  of  80  merchant  vessels  positions  gained  during  a 
twelve-hour  period  in  the  Strait  of  Gibraltar  to  prepare  data  for  testing  both  ORCA 
formulations.  We  calculate  nodes  positions  for  all  the  moving  COIs.  We  consider 
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up  to  four  air  assets  to  visit  the  prioritized  COIs.  All  air  assets  leave  and  return  to 
the  moving  mother  warship  within  their  endurance.  We  assume  that  COIs  sail 
with  a  constant  course  and  speed  far  from  the  coastline,  and  the  mother  warship 
is  sailing  within  an  estimated  middle  position  of  all  the  COIs. 

We  show  results  for  both  formulations  without  heuristics  for  several  sets  of 
different  sizes  of  COIs  (20,  40  and  80)  and  time  windows  (5,  10,  15  and  20). 
Thereafter,  to  speed  solution  time,  we  heuristically  solve  both  formulations  for 
one  air  asset  at  a  time.  Finally,  we  use  a  heuristic  arc  elimination,  in  addition  to 
the  looping  heuristic,  applying  it  only  to  the  ORCA  VT  formulation.  This  heuristic 
eliminates  or  penalizes  the  longest  transitions  between  COIs  to  reduce  the  size 
of  the  problem. 

Due  primarily  to  aircraft  speed  and  range  limitations,  we  estimate  the 
usual  mix  of  helicopters  and  small  UAVs  embarked  on  destroyers  and  frigates  in 
a  typical  scenario  at  sea  (far  from  the  coastline)  is  able  to  visit  approximately  40 
COIs  during  a  six-hour  time  window.  Using  ORCA  to  fit  manual  naval  air  planning 
and  execution  processes  implies  achieving  a  solution  within  30  minutes.  For  such 
typical  scenarios,  both  formulations  offer  good  optimal  or  close  to  optimal 
solutions  within  this  time  limit.  The  ORCA  VT  uses  less  air  assets  than  the  ORCA 
Tl  but  it  requires  a  longer  time  limit,  especially  if  we  increase  the  number  of  time 
windows.  For  unusual  big  sets  of  40  to  80  COIs,  we  find  ORCA  Tl  provides  an 
acceptable  solution  within  30  minutes,  and  in  some  cases  we  can  get  feasible 
solutions  in  less  than  two  minutes,  but  ORCA  VT  with  heuristic  arc  elimination  is 
superior  if  given  up  to  two  hours. 
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I.  INTRODUCTION 


A.  PURPOSE  AND  OVERVIEW 

A  warship  at  sea  requires  awareness  of  the  ships  in  its  vicinity  in  order  to 
operate  safely.  At  times,  this  can  be  a  daunting  task,  even  when  equipped  with 
multiple  shipboard  systems.  If  naval  air  assets  are  available,  a  Tactical  Action 
Officer  (TAO)  directs  them  to  gain  additional  information  about  as  many  surface 
Contacts  of  Interest  (COIs)  as  possible.  These  air  asset  routes  can  be  inefficient 
because  there  are  no  shipboard  systems  to  aid  with  route  planning.  Additional 
complications  include  COIs  moving  during  a  route,  and  some  COIs  being  more 
important  to  visit  than  others.  This  thesis  formulates  and  implements  two  Optimal 
Routing  of  Coordinated  Aircraft  (ORCA)  Integer  Linear  Programs  (ILPs)  to  plan 
air  asset  routes  that  visit  as  many  prioritized  COIs  as  possible  in  a  fixed  time 
horizon. 

Current  warships  with  helicopter  capabilities  have  shipboard  systems  that 
provide  a  partial  surface  tactical  picture.  We  define  the  surface  tactical  picture  as 
information  about  ships  around  a  warship  displayed  in  a  combat  system  to  help  it 
make  tactical  decisions.  Forward-Looking  Infrared  (FLIR)  imaging  systems 
aboard  most  warships  permit  visual  identification  of  all  contacts  within  12  nautical 
miles  (nm).  Some  other  onboard  systems,  such  as  radar  systems,  enable  crews 
to  make  relatively  accurate  deductions  within  30  nm.  Since  2004,  the 
implementation  of  the  Automatic  Information  System  (AIS)  by  the  International 
Maritime  Organization  (2002)  allows  crews  to  recognize  many  contacts  within  50 
nm  by  direct  signal  reception,  simplifying  and  greatly  enriching  the  surface 
tactical  picture,  although  its  range  continuously  varies  with  the  propagation 
conditions  of  the  atmosphere,  and  deception  is  possible  without  additional 
confirmation  gained,  for  example,  by  an  air  asset. 

Complicating  the  surface  tactical  picture,  AIS  usage  is  only  mandatory  for 
some  ships.  Usually,  all  maritime  traffic  subject  to  the  1974  International 
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Convention  for  the  Safety  of  Life  at  Sea  employs  it  unless  certain  conditions, 
such  as  a  piracy  risk,  are  present  in  their  transiting  area.  A  correlation  between 
remote  databases  and  AIS  data  received  onboard  can  be  made  for  each  contact, 
achieving  an  almost  complete  picture  of  a  huge  area.  The  absence  of  AIS  signals 
on  a  radar  echo  is,  in  most  cases,  classified  as  a  COI  for  surface  identification 
purposes.  Many  fishing  vessels,  small  boats,  and  other  special  ships  (like 
warships)  do  not  transmit  AIS  signals.  The  known  pattern  of  sea  life  allows  us  to 
make  an  educated  guess  regarding  the  activities  of  some  of  these  non-AIS- 
transmitting  ships,  and,  when  the  opportunity  arises,  evaluate  them  as 
candidates  for  further  investigation  with  an  air  asset. 

Warships  use  air  assets — typically  a  naval  helicopter  or  an  unmanned 
aerial  vehicle  (UAV) — to  complete  the  surface  tactical  picture.  A  surface  search 
flight  of  any  organic  air  asset — belonging  to  a  destroyer  or  frigate — is  typically 
conducted  twice  a  day  during  peacetime  operations.  In  a  pre-flight  briefing,  the 
TAO,  helped  by  the  Air  Asset  or  Helicopter  Controller  (HCO),  establishes  the 
intended  flight  pattern  to  be  carried  out  by  the  pilots,  as  well  as  search  priorities. 
Because  a  surface  picture  is  dynamic,  priorities  sometimes  change  after  the  air 
asset  is  underway. 

An  AIS  data  equipped  air  asset  can  provide  useful  advantages.  When  an 
SH-60  helicopter  takes  off  from  deck  and  gains  altitude,  the  helicopter's  AIS 
picture  can  reach  as  far  as  300  nm  and  this  can  be  shared  with  its  warship  using 
a  data  link.  Figure  1  presents  a  hypothetical  example  to  show  how  different  the 
picture  can  become  with  an  airborne  air  asset.  Therefore,  some  gaps  in  the 
information  provided  by  the  AIS  equipment  onboard  the  warship  are  instantly 
completed,  and  the  surface  tactical  picture  snapshot  changes.  Then,  the  desired 
route  for  the  helicopter  can  change  as  well. 
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Without  an  Equipped  Air  Asset  Flying  (left).  With  an  Equipped  Air  Asset  Flying 
(right). 

Figure  1.  Hypothetical  Example  of  the  Surface  Tactical  Picture. 


Figure  2  shows  a  TAO  and  HCO  working  environment  in  a  warship’s 
Combat  Information  Center.  Figure  3  shows  common  types  of  air  assets 
employed  to  identify  surface  COIs. 


Source:  Department  of  the  Navy  (2017)  (left);  Source:  Commander,  U.S.  Pacific 
Fleet  (2017)  (right). 

Figure  2.  Shore-Based  Aegis  Ashore  Team  Trainer  in  Virginia  Beach,  VA 
(left).  Console  Operator  Aboard  USS  Normandy  (CG  60)  (right). 
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Source:  Armada  Espanola  (n.d.)  (left);  Source:  Nieto  (2016)  (right). 

Figure  3.  Spanish  Navy  SH-60B  Helicopter  during  In-flight  Refueling  (left). 

Scan  Eagle  Takeoff  from  ESPS  Galicia  (L-51)  (right). 


B.  AIR  ASSETS 

Various  embarked  air  assets  operate  from  warships  and  are  employed  to 
investigate  COIs.  This  thesis  considers  AIS  and  FLIR  equipped  helicopters,  and 
longer  endurance  UAVs. 

1.  SH-60 

The  SH-60  is  a  naval  helicopter  (see  Figure  4)  widely  used  by  many 
navies  around  the  world  since  the  1970s.  It  is  manufactured  by  United 
Technologies  Corporation,  Sikorsky  Aircraft  Division,  and  is  currently  in  service  in 
many  of  its  variants  and  evolutions. 


(J  JSKI  712  »LJ2*  71 


Figure  4.  SH-60  Silhouette.  Source:  Sikorsky  Archives  (2017). 
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2.  Scan  Eagle 

The  UAV  Scan  Eagle  (see  Figure  5)  is  currently  in  use  in  the  U.S.  Navy.  It 
is  manufactured  by  Insitu  Inc.,  and  has  proved  to  be  an  efficient  and  low-cost 
alternative  for  Identification,  Surveillance,  and  Reconnaissance  also  in  the 
maritime  environment.  Table  1  shows  data  from  several  open  sources, 
highlighting  the  assumed  endurance  and  the  assumed  speed  of  the  UAV,  as  well 
as  its  maximum  range  of  operation  from  the  ship. 


Figure  5.  Scan  Eagle  UAV.  Source:  Insitu  (n.d.). 


Table  1 .  Air  Assets  Data. 


Parameter 

SH-60 

Scan  Eagle 

Max  Endurance  (hours) 

3.5 

24+ 

Assumed  Endurance  (hours) 

3 

6 

Service  Ceiling  (feet) 

12.000 

15.000 

Max  Speed  (knots) 

180 

80 

Cruise  speed  (knots) 

140 

50-60 

Assumed  Speed(knots) 

120 

60 

Range  (nautical  miles) 

190 

80 

Adapted  from  Department  of  the  Navy  (2017),  Lockheed  Martin  (n.d.),  and 
Insitu  (n.d.). 
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c. 


CONTACTS  OF  INTEREST 


A  vessel’s  designation  as  a  COI  depends  on  its  position  and  behavior. 
Most  of  the  time  transiting  ships  follow  a  precise  route  to  save  fuel  and  time. 
Many  websites  track  the  majority  of  the  AIS  vessel  positions  and  density  graphs 
(see  Figure  6)  show  their  expected  routes.  We  expect  other  vessels  in 
designated  areas  to  occasionally  loiter  due  to  fishing. 


Figure  6.  Shipping  Density  Map.  Source:  Marine  Traffic  (n.d.). 

COIs  move  at  different  speeds,  usually  from  8  to  25  knots,  and  in  different 
courses,  from  0  to  360  degrees.  The  mother  warship  of  the  air  assets  is  also 
moving.  Figure  7  shows  a  basic  example  of  this  relative  motion  for  several  ships 
in  a  fixed  time  interval.  Each  cell  has  a  10  nm  side,  k  =  1  represents  the  mother 
warship,  and  k  from  2  to  5  are  four  COIs  located  near  the  corners  of  the  graph. 


Ly— — 

ks 2 

s 

b=3 

> 

£=  1 

&=5 
□ - 

k=A 

Figure  7.  Basic  Example  of  Relative  Motion  of  Five  Ships. 
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Prior  intelligence  and  current  operations  determine  COI  priorities. 
Sometimes,  we  have  intelligence  regarding  a  COI  requiring  prioritized 
investigation.  It  is  also  important  for  the  surface  tactical  picture  to  clarify  the 
identity  of  any  foreign  warships  in  the  area.  COIs’  classification  criteria  are 
usually  established  as  a  part  of  the  operational  task  orders,  either  standing  or 
operation  specific.  Maritime  situation  indicators  define  specific  behaviors  that 
should  be  investigated. 

D.  MOTIVATION  OF  THE  PROBLEM 

Modern  combat  systems,  like  AEGIS,  offer  decision  aids  employing 
doctrine  to  simplify  planning,  but  no  such  aid  exists  for  planning  air  routes  to 
investigate  as  many  prioritized  COIs  as  possible.  Calfee  (2003)  shows  the  power 
of  these  doctrine  techniques  (Auto-Standard  Missile,  Auto-Special  Missile, 
Identification  Friend  or  Foe,  Identification,  and  Drop-Track  doctrines),  which 
permit  the  operators  to  simplify  their  jobs  by  configuring  the  system  to  carry  out 
automatic  actions.  As  a  result,  some  pre-planned  reactions  are  easily  and  quickly 
executed  with  a  lower  human  margin  of  error. 

Personal  experience  shows  that  no  doctrine  or  automatic  tool  exists 
onboard  warships  to  help  the  TAO,  the  Anti-Surface  Warfare  Officer  or  the  FICO 
to  solve  this  problem.  Many  times,  the  resulting  route  is  poor.  Automatic  routing 
of  air  assets  would  help  busy  operators. 

E.  THESIS  ORGANIZATION 

Chapter  II  presents  related  literature.  Chapter  III  details  two  different 
ORCA  Mixed  Integer  Linear  Programs  (ILPs).  Chapter  IV  explains  the  data 
generation.  Chapter  V  proposes  constraints  to  reduce  the  number  of  arcs,  and 
Chapter  VI  presents  a  real  world  case  study  taken  from  the  Strait  of  Gibraltar. 
Chapter  VII  provides  conclusions  and  opportunities  for  the  future  research. 
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II.  LITERATURE  REVIEW 


There  is  a  rich  and  extensive  literature  presenting  formulations  and 
solution  techniques  for  applications  similar  to  ORCA,  but  we  find  no  previously 
published  research  that  directly  addresses  the  application  we  consider  in  this 
thesis.  This  chapter  reviews  select  literature  that  provides  formulations  similar  to 
those  we  employ  for  ORCA.  It  also  reviews  some  related  applications 

Dantzig,  Fulkerson,  and  Johnson  (1954)  describe  and  obtain  a  solution  to 
a  Travelling  Salesman  Problem  (TSP)  with  49  cities  in  the  United  States, 
showing  the  feasibility  of  solving  problems  with  a  moderate  number  of  nodes 
using  binary  variables  to  denote  a  transit  from  city  i  to  city  j.  Tsiligirides  (1984) 
develops  heuristic  methods  to  solve  the  generalized  Orienteering  Problem  (OP). 
Golden,  Levy  and  Vohra  (1987)  propose  an  effective  center  of  gravity  heuristic 
that  improves  previous  literature,  and  Balas  (1989)  formulates  the  Prize 
Collecting  Traveling  Salesman  Problem  using  rewards  and  penalties  for  cities 
visited.  Toth  and  Vigo  (2001)  describe  the  TSP  with  Time  Windows  (TSPTW)  as 
a  special  case  of  the  Vehicle  Routing  Problem  with  Time  Windows  (VRPTW)  as 
NP-hard  in  the  strong  sense,  as  well  as  the  Multiple  TSPTW  (MTSPTW). 

Vansteenwegen,  Souffriau,  and  Oudheusden  (2010)  review  the  literature 
of  the  OP  and  its  applications,  presenting  the  relevant  variants  with  clarity  and 
simplicity.  These  are  similar  to  the  first  (time  variable)  ORCA  formulation 
presented  in  this  thesis. 

Lawler,  Lenstra,  Rinnoy  Kan,  and  Shmoys  (1990)  summarize  the  Time 
Dependent  TSP  introduced  by  Fox,  Gavish,  and  Graves  in  1980.  These  are  most 
similar  to  the  second  ORCA  formulation  presented  in  this  thesis.  Brown  and 
Carlyle  (2008)  optimize  the  employment  of  U.S.  Navy’s  Combat  Logistics  Force, 
day  by  day  in  a  whole  world  scenario  given  the  positions  of  a  number  of  tasked 
Battle  Groups  are  known.  The  base  network  they  employ  is  scenario 
independent,  with  102  commonly  used  nodes  (as  choke  points)  connected  by 
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198  arcs  that  can  include  two  arcs  between  the  same  node  pair  representing 
slow  and  fast  transit.  Then,  they  increment  the  network  in  two  steps,  first  adding 
daily  positions  of  Battle  Groups  (commonly  13)  increasing  to  around  600  nodes 
and  700  arcs,  and,  finally,  introducing  nodes  as  waypoints  in  arc  intersections. 
With  around  900  nodes  and  64,000  arcs,  this  simplifying  approach  enables  quick 
solution  time. 

In  other  applications  related  to  ORCA,  Sposato  (1995)  plans  “Optimal 
Routing  of  Ice  Reconnaissance  Aircraft”  using  an  OP  formulation.  The  plan  seeks 
routes  to  identify  moving  icebergs  in  a  search  area  discretized  into  2,600  nodes. 
Hartman  (2015),  develops  a  Rapid  Airlift  Planning  for  Amphibious-Ready  Groups 
Route  Optimizing  Program  as  a  multiple  Vehicle  Routing  Problem  (VRP)  with 
multiple  locations,  employing  earliest  to  latest  admissible  landing  times  of 
aircrafts  that  transport  personnel  and  materiel  between  ships  in  fixed  positions. 

There  is  a  related  and  extensive  search  theory  literature.  For  example, 
Stone,  Royset,  and  Washburn  (2016)  show  methods  to  search  moving  targets. 
They  present  algorithms  to  find  targets  both  in  discrete  and  continuous  time  and 
space.  Unlike  these  search  problems,  this  thesis  assumes  that  all  COIs’ 
positions,  constant  courses,  and  constant  speeds  are  available  as  data,  and  the 
main  purpose  here  is  to  obtain  routes  for  air  assets  that  visit  as  many  prioritized 
COIs  as  possible.  Although  sometimes  these  kind  of  missions  receive  the  name 
of  surface  search,  they  are  not  really  searching  but  identifying  routes. 
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III.  FORMULATION:  THE  MIXED-INTEGER  LINEAR 

PROGRAMS 


A.  INTRODUCTION 

This  chapter  presents  two  ORCA  ILPs  along  with  assumptions,  data, 
variables  and  constraints  for  both. 

B.  TIME  WINDOWS  AND  A  VARIABLE  FOR  TIME  OF  VISIT 

In  our  first  formulation,  “VT,”  we  use  a  variable  to  represent  the  visit  time 
for  each  air  asset  and  COI,  and  we  model  each  COI  using  multiple  nodes.  Each 
node  has  a  time  window  in  which  it  can  be  visited,  and  we  restrict  all  air  assets  to 
visit  at  most  one  of  the  nodes  for  each  COI.  In  Figure  8,  we  show  the  division  of 
the  future  positions  of  a  COI  into  time  windows  based  on  its  course,  its  speed, 
and  the  total  endurance  of  the  air  asset. 


Figure  8.  COI  Nodes  (with  6  Time  Windows)  Based  on  Its 
Course,  Its  Speed  and  Air  Asset’s  Endurance. 


In  Figure  9,  we  show  a  small  example  with  6  time  windows  per  COI  and  a 
single  air  asset  at  100  knots  with  3.5  hours  endurance.  If  all  COIs  and  mother 
warship  (ship  where  air  assets  leave  and  return)  proceed  at  10  knots,  the  side  of 
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each  cell  is  10  nm,  and  all  COIs’  scoring  value  is  the  same,  the  air  asset  leaves 
the  mother  warship,  and  completes  the  tour  indicated  by  the  blue  arrows  arriving 
back  at  its  mother  warship  in  its  last  time  window.  Each  time  window  node  has  an 
earliest  and  a  latest  time  of  visit.  A  variable  records  the  time  the  air  asset  visits  a 
node. 


i=l  ;=8  i=9  ;=10  i  =11  i  =12 


k=  3 

i=13 
i=  14 
i= 15 
i=16 
i=17 
2=18 


1=24 
2=22 
2  =22 
2=21 
i=20 

i=19 

fc=  4 


Figure  9.  VT  Small  Example  for  a  Single  Air  Asset. 


1.  Assumptions 

Air  assets  routing  requires  assumptions  about  flight  operations: 

1 .  All  air  assets  take  off  at  the  same  time. 

2.  Different  types  of  air  assets  have  different  endurance  and  speed. 

All  air  assets  have  constant  speed  without  considering  wind 
influence,  altitude  changes,  or  course  variations. 

3.  All  distances  are  calculated  using  a  great  circle  formula. 

4.  It  is  beneficial  to  leave  an  aircraft  idle  if  it  is  not  needed.  To  model 

this,  we  include  a  prize  in  the  objective  function  that  rewards  any  air 
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asset  transition  from  the  mother  warship’s  initial  position  directly  to 
its  last  position. 

There  is  one  node  for  each  time  window  for  each  COI. 


h  e  H 
i  e  I 
k  e  K 
i  e  Ch 

i  £  SETk 
i e  Wh 


3. 

e.  ,  l. 

M 

nouseh 

score  , 

i,h 


4. 

i  e  //V  ; 


Sets 

air  assets 

nodes  (alias  j  and  p) 

COIs,  and  the  warship  (k  =  1  is  warship) 
nodes  that  can  be  visited  by  air  asset  h 
nodes  corresponding  to  COI  k 

nodes  for  feasible  termination  of  air  asset  h  route  at  the 
mother  warship 

Parameters 

earliest  and  latest  time  to  visit  i 
big  constant 

reward  for  keeping  h  aboard;  nouseh  <  l^-min [scoreih] 
reward  for  air  asset  h  visiting  COI  k  at  node  i  e  SETk 
time  to  fly  from  i  to  j  for  air  asset  h,  such  that 

ei +  Tij,h  -  lj  ’  Vi'o' 

Calculated  Sets 

all  nodes  that  can  immediately  precede  node  j  in  a  feasible 
tour,  such  that 

ei+Tij,h  -lj>  ViJ 
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j  e  OUT  nodes  that  can  immediately  follow  node  i  in  a  feasible  tour 

such  that, 

ei + Tij,h  - lj ’  v7./' 

5.  Variables 

Tih  time  of  visit  to  node  i  by  air  asset  h 

Xi  j  h  1  if  air  asset  h  goes  directly  from  node  i  to  node  j,  0 

otherwise 

Yih  1  if  node  i  is  visited  by  air  asset  h,  0  otherwise 


6.  Formulation 

max  Ysscorei,h'Yi,h+  Z  nouseh-Xu,h 

i,h  h  ,  i&Wh 

(3.1) 

£  s  1 

ieSET{  ,  j&OUTj 

V/z 

(3.2) 

£  X,.;.,  i  1 

ieS£T* ,  ye  Of/7;  ,  A 

Vfc  >1 

(3.3) 

£  i 

jcOUTt 

V/z 

(3.4) 

I  X/J.h  =  1 

i,;W4nOOTj 

v/i 

(3.5) 

Vi,  j,h 

(3.6) 

Vi  ,/z 

(3.7) 

VI 

-c 

w* 

Vi  ,/z 

(3.8) 

izINp\Wh  i^OUTp\{\} 

V/i,  p  e  Ch 

(3.9) 

Z  x i,p,h — 

V/i,  /?  g  W),  ,  p  *  1 

(3.10) 
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^  ^  X p,j,h  ^ p,h 

V  h ,  p  Wh  ,p*  1 

(3.11) 

M 

Z  i 

(3.12) 

ieSETk  ,h 

v/,  7,  /? 

\/i,h 

r,eir 

\/i,h 

7.  Discussion 

The  objective  function  (3.1)  expresses  the  total  score  obtained  by  the 
complete  set  of  air  assets  with  a  reward  for  any  unused  air  asset.  Constraints 
(3.2)  ensure  that  each  air  asset  h  leaves  the  mother  warship  at  most  once. 
Constraints  (3.3)  guarantee  that  only  one  of  the  air  assets  can  leave  a  COI  k, 
except  the  mother  warship.  Each  constraint  (3.4)  and  (3.5)  forces  all  air  assets  h 
to  begin  leaving  the  mother  warship,  and  to  finish  arriving  the  mother  warship. 
Constraints  (3.6)  provide  the  time  of  visit  to  a  node  on  a  route.  Each  constraint 
(3.7)  and  (3.8)  enforce  the  earliest  and  latest  visit  times  for  each  node. 
Constraints  (3.9)  control  the  balance  of  flow  for  each  air  asset’s  type  (helicopters 
and  UAVs).  Constraints  (3.10)  and  (3.11)  ensure  an  air  asset  h  both  enters  and 
leaves  a  visited  node.  Constraints  (3.12)  restrict  to  one  the  number  of  visits  to 
any  COI. 

C.  TIME  INDEXED  FORMULATION 

In  our  second  formulation,  “Tl,”  we  model  each  COI  using  multiple  time 
steps  by  including  a  time  index  on  the  binary  variables.  In  Figure  10,  we  show  a 
small  example  with  6  time  steps  per  COI  and  a  single  air  asset  with  5.5  hours’ 
endurance.  For  simplicity,  we  assume  only  integer  time  steps  for  this  example. 
All  parameters  are  similar  to  the  VT  formulation  example.  Binary  variables  need 
to  be  indexed  both  by  the  leaving  and  the  arriving  node  as  well  as  by  the  proper 
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time  indices  for  the  leaving  and  arriving  time  step  at  each  one  of  the  nodes 
(COIs). 


2= 1  2= 2  2=3  2=4  2=5  2=6 


r=3 

2=1 

1=2 
2= 3 
2=4 
2=5 
i^6 


2=6 

^5 

2=4 

2=3 

2=2 

2=1 

r=4 


Figure  1 0.  Tl  Small  Example  for  a  Single  Air  Asset. 


1.  Assumptions 

Assumptions  1  to  4  of  the  VT  formulation  are  also  valid  in  this  formulation. 

2.  Sets 

heH  air  assets 

i  e  I  air  assets’  mother  warship  (/'  =  !)  and  COIs  (alias  j  and  p) 

teT  time  steps  (alias  t'),  an  integer  set  for  all  COIs  i 

t  e  Fh  set  of  allowed  first  times  for  air  asset  h 

2 '  sLh  set  of  allowed  last  times  for  air  asset  h 
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3. 


Parameters 


eit  ,  lit  earliest  and  latest  time  to  visit  i  at  time  step  t, 

nouseh  reward  for  keeping  h  aboard;  nouse h  <  scoreith},  \/i,t 

scorej  t  h  score  for  visiting  COI  i  at  time  step  t  with  air  asset  h\ 

riJ  t  t.h  time  to  fly  from  i  to  j  leaving  at  t  and  arriving  at  t’  by  asset  h 

4.  Calculated  Set 

(i,j,t,t\h)  e  A  set  of  all  feasible  transitions  for  air  asset  h\  ( i,j,t,t\ti)&A  if 

ei,t+  O’-O  ^  h-e  ’ 

i  *  j  . 

0=1  A  tzFh)v(i*  1  a  ttFh), 

(/  =  I  tsFh),  and 
(J  =  1  <=>  {'eLh) 

5.  Variables 

Xijtl,h  1  if  air  asset  h  goes  directly  from  COI  i  at  time  step  t  to  COI  j 

at  time  t’,  0  otherwise 

Yith  1  if  air  asset  h  visits  COI  i  at  time  step  t,  0  otherwise 

6.  Formulation 

max  I  SCOT’S j  t,h  ■  Yjt,h  +  I  nouse h  -Xntt.h  (3.13) 

j,t',h  h,teFh,t'eLh 

E  X^-l  VA  (3.14) 

j,  t  eFh,  f  I 
( l,j,t,t',h)eA 
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(3.15) 


i,  t,  t'e  Lh  I 


V  x  =  V  Y 

/  j  ^  i,p,t',t,h  /  J  ^  p,j,t,t\ 


i,  t'  I 


j ,  *'  I 

(. p,j,t,t',h)eA 


i,  t,  t'  I 
(i,p,t\t,h)eA 


V  v  =Vy 

p,j,t,t',h  p,t,i 


j.  t,f  i 
(. p,j,t,t'.h)eA 


t.h 


YP,t,h  *  1 


^{<U} 


V/7 


Vp*l,\/t£Fh,  t£Lh  ,\/h  (3.16) 


V/7,  h 


(3.17) 


V/7,  h 


(3.18) 


V/7  *  1 


(3.19) 


V(i,j,t,t',h)eA 

\/i,t,h 


7.  Discussion 

The  objective  function  (3.13)  maximizes  the  total  score  obtained  by  the 
complete  set  of  air  assets  h  plus  a  reward  if  we  do  not  use  all  air  assets. 
Constraints  (3.14)  ensure  that  all  air  assets  h  begin  leaving  the  mother  warship 
during  their  first  time  step,  while  constraints  (3.15)  ensure  that  all  air  assets  h 
finish  at  the  mother  warship  in  the  last  time  step.  Constraints  (3.16)  define  the 
balance  of  flow  for  each  COI,  while  constraints  (3.17),  (3.18),  and  (3.19)  define  a 
single  visit  to  any  COI. 
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IV.  DATA  PREPARATION 


A.  INTRODUCTION 

ORCA  prescribes  a  routing  of  air  assets  given  initially  defined  positions  of 
a  number  of  COIs  and  their  expected  future  positions.  Multi  sensor  combat 
systems  have  these  data  available  at  all  times.  To  simulate  this  data,  we  use  a 
real  data  set  of  merchant  vessels  transiting  across  the  Strait  of  Gibraltar.  This 
chapter  describes  this  data  and  its  preparation  for  both  formulations. 

B.  AIS  RAW  DATA  CLEARING 

AIS  data  is  easily  available  and  provides  data  for  ORCA  test  instances. 
The  Spanish  Navy's  “Centro  de  Operaciones  y  Vigilancia  de  Accion  Maritima ” 
(Surveillance  and  Maritime  Action  Operations  Center),  which  monitors  maritime 
traffic  in  the  area  of  interest,  provided  AIS  data  taken  from  the  Strait  of  Gibraltar 
shore  station  on  November  13,  2016,  from  0000Z  to  1200Z.  Data  consists  of  80 
merchant  vessels,  which  transited  across  the  area  during  the  period.  We 
consider  instances  with  subsets  of  these  80  COIs  as  well  as  all  80. 

Figure  1 1  shows  a  sample  of  the  raw  data  as  provided  in  “csv”  format. 
Data  for  each  COI  consist  of  a  variable  number  of  lines  corresponding  to 
reported  positions,  as  a  function  of  range  to  the  shore  station  and  speed  of  each 
COI  (i.e.,  Nexoe  Maersk,  in  Figures  11  and  12,  with  flag  of  Denmark  and 
Maritime  Mobile  Service  Identity  number  219955000,  reports  6  position  lines  from 
021 8Z  to  0250Z,  with  the  first  line  having  timestamp  2016-11-13  at  02:50:05Z, 
latitude  36’  01.23,”  longitude  005’  04.53”  W,  on  course  082.5  degrees  at  20 
knots). 

We  process  the  data  for  each  COI  using  Python  2.7.13  (2017).  We 
assume  the  last  recorded  course  is  constant,  and  we  use  the  great  circle 
distance  to  calculate  any  future  position.  We  locate  the  mother  warship  at  the 
mean  latitude  and  the  mean  longitude  of  all  COIs  to  simulate  data  generated  by 

systems  on  the  mothership,  at  0400Z  (initial  reference  time  for  all  COIs). 
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Ship  Name :  NEXOE  MAERSK, , , , , 

Call  Sign:  OVYB2,,,,, 

Timestamp, Lat, Lon, Heading, Speed, Source 

2016-11-13  02:50:05Z,36o01.23,N,005°04.53'W,82.5,20, T-AIS 
2016-11-13  02:43:58Z,36<>00.97'N,005o07.05'W,83.4,20.4, T-AIS 
2016-11-13  02:36:58Z,36'>00.72,N,005°09.96,W,85.5,20 . 3, T-AIS 
2016-11-13  02:30:55Z,36°00.54'N,005°12.43'W,84.9,20.8, T-AIS 
2016-11-13  02:24:40Z,36°00.37'N,005°15.17'W,87.4,20. 6, T-AIS 
2016-11-13  02 : 18 : 22Z, 36 “00. 27' N, 005° 17. 7 l’W, 87. 2, 18. 5, T-AIS 

Figure  1 1 .  COI  Data  Example. 


Figure  12.  Nexoe  Maersk.  Source:  Ship  Spotting  (n.d.). 

C.  TIME  WINDOWS  GENERATION 

Future  positions  of  moving  COIs  with  constant  course  and  speed  can  be 
easily  calculated  using  great  circle  distances.  We  consider  a  time  horizon  of  up  to 
six  hours.  Each  time  window  is  of  equal  duration  and  we  construct  up  to  20  time 
windows  (a  duration  of  18  minutes)  for  each  COI.  We  consider  the  COI  is  located 
at  a  fixed  position  (the  mean  location  during  the  time  window)  for  the  duration  of 
the  time  window. 

Using  Google  Earth  Pro  version  7.1.7.2606  (2016),  Figure  13  shows  all 
positions  associated  with  all  COIs  considering  six  hours  and  ten  time  windows. 
Green  and  red  dots  represent  first  and  last  positions  for  the  80  COIs,  and  yellow 
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dots  represent  middle  positions.  The  distribution  of  all  COIs  seems  close  to  the 
real  density  distribution  of  the  common  maritime  traffic  pattern  in  the  area. 


Figure  13.  Ten  Time  Windows  for  All  COIs. 


D.  SCENARIO  RELOCATION 

The  ORCA  problem  would  typically  be  used  by  warships  and  their  air 
assets  located  away  from  coastline  chokepoints.  To  simulate  this  environment, 
we  relocate  all  COI  positions  by  introducing  an  offset  of  4  degrees  to  the  west  to 
all  latitudes  and  longitudes.  In  Figures  14  and  15  we  show  a  transformation  of  all 
COI  positions  to  the  west. 


Figure  1 4.  Offset  Included  for  All  COIs. 
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Figure  1 5.  Final  Segments  of  Positions  for  All  COIs. 
In  Table  2  we  show  final  data  after  all  modifications. 


Table  2.  Processed  COIs  Data  Used  for  Chapter  VI. 


Latitude 

Longitude 

Course 

Speed 

Score 

# 

Name 

degs 

mins  secs 

degs 

mins 

secs 

(degs) 

(knts) 

36 

2 

2 

-5 

-13 

-45 

090.0 

3.0 

100 

0 

mother  warship 

36 

7 

35 

-4 

-1 

-55 

082.7 

13.5 

100 

1 

N/A 

35 

46 

26 

-6 

-39 

-34 

257.6 

18.7 

100 

2 

Cala  Pino 

36 

9 

19 

-4 

-3 

-41 

081.0 

14.0 

100 

3 

Thun  Goliath 

36 

5 

52 

-3 

-42 

-31 

085.5 

18.9 

100 

4 

YM  Wellhead 

35 

51 

19 

-4 

-5 

-21 

102.0 

14.8 

100 

5 

X-PRESS  Mulhacen 

36 

14 

12 

-5 

-52 

-35 

293.3 

9.0 

100 

6 

Brussels 

36 

5 

0 

-5 

-48 

-18 

274.6 

7.7 

100 

7 

Lake  Ontario 

36 

5 

42 

-5 

-28 

-3 

286.0 

2.5 

100 

8 

British  Emissary 

36 

20 

37 

-5 

-48 

-26 

302.1 

10.3 

100 

9 

Irenes  Rainbow 

36 

14 

28 

-3 

-46 

-40 

078.7 

22.0 

100 

10 

Rhapsody 

35 

51 

22 

-6 

0 

-51 

254.0 

13.4 

100 

11 

MSC  Loretta 

36 

13 

6 

-5 

-51 

-27 

289.5 

10.6 

100 

12 

Marchicora 

35 

45 

30 

-5 

-25 

-41 

198.2 

6.8 

100 

13 

N/A 

35 

52 

47 

-5 

-48 

-4 

249.9 

11.2 

100 

14 

Stolt  Kingfisher 

36 

4 

15 

-4 

-35 

-56 

082.5 

20.0 

10,000 

15 

Nexoe  Maersk 

36 

4 

25 

-4 

-41 

-19 

080.8 

19.8 

100 

16 

Aquamarine  Ace 

36 

1 

2 

-5 

-35 

-4 

263.2 

19.0 

100 

17 

MSC  Fillippa 

36 

11 

36 

-4 

-56 

-55 

051.7 

17.1 

100 

18 

Al  Andalus 

36 

5 

5 

-5 

-21 

0 

287.6 

3.5 

100 

19 

Star  Omicron 

36 

0 

35 

-5 

-24 

-29 

259.9 

9.8 

1,000 

20 

Arklow  Meadow 
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Latitude 

Longitude 

Course 

Speed 

Score 

# 

Name 

degs 

mins  secs 

degs 

mins 

secs 

(degs) 

(knts) 

36 

1 

6 

-5 

-19 

-8 

260.3 

12.8 

100 
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Saga  Sapphire 

36 

0 

6 

-5 

-10 

-37 

081.0 

14.2 

100 

22 

Delta  IOS 

36 

2 

14 

-5 

-13 

-38 

258.4 

12.3 

100 

23 

Hansa  Cloppenburg 

36 

4 

14 

-5 

-15 

-59 

270.0 

4.7 

100 

24 

Krartia 

36 

3 

48 

-5 

-10 

-34 

249.0 

12.1 

10,000 

25 

Emerald 

35 

58 

56 

-5 

-18 

-40 

081.9 

17.9 

100 

26 

MSCAriane 

36 

0 

47 

-5 

-6 

-32 

287.5 

11.3 

100 

27 

SFL  Spey 

35 

54 

25 

-5 

-23 

-35 

079.2 

14.5 

100 

28 

Smeraldo 

35 

58 

46 

-5 

-22 

-27 

080.8 

13.8 

100 

29 

Reggedijk 

36 

4 

18 

-4 

-52 

-24 

261.0 

13.1 

1,000 

30 

Aguabreeze 

35 

56 

34 

-5 

-41 

-11 

078.6 

16.0 

100 

31 

STENAWECO  Excellence 

36 

4 

14 

-4 

-49 

-9 

262.0 

11.3 

100 

32 

N/A 

35 

57 

16 

-4 

-50 

-48 

287.2 

10.2 

100 

33 

Azamanta 

35 

59 

44 

-4 

-52 

-23 

281.5 

8.9 

100 

34 

BW  Raven 

36 

4 

40 

-4 

-46 

-12 

269.2 

10.1 

100 

35 

Nissos  Serif  os 

36 

4 

24 

-4 

-59 

-53 

271.0 

5.9 

100 

36 

Mila 

36 

7 

36 

-4 

-46 

-17 

258.0 

10.0 

100 

37 

Ionic  Smyrni 

35 

57 

27 

-5 

-11 

-3 

316.0 

3.4 

100 

38 

High  Beam 

36 

7 

22 

-4 

-41 

-17 

258.0 

10.1 

100 

39 

Atlantis  Aldabra 

35 

50 

57 

-4 

-56 

-16 

309.6 

7.1 

100 

40 

Thorco  Isabella 

36 

13 

24 

-4 

-42 

-34 

249.2 

9.5 

100 

41 

Patron 

36 

1 

39 

-4 

-17 

-8 

262.7 

11.3 

100 

42 

Voornedijk 

36 

14 

23 

-4 

-33 

0 

251.7 

11.0 

100 

43 

Herbania 

35 

51 

6 

-6 

-9 

-26 

079.0 

13.9 

100 

44 

Pannonia  G 

35 

49 

9 

-6 

-41 

-2 

080.7 

19.4 

100 

45 

MSC  Lisbon 

36 

15 

18 

-4 

-2 

-58 

252.0 

13.8 

100 

46 

Blue  Ocean 

36 

9 

23 

-4 

-23 

-31 

260.5 

9.8 

100 

47 

Equinox  Dawn 

35 

57 

28 

-6 

-27 

-14 

087.2 

14.4 

100 

48 

Brook  Trout 

35 

52 

28 

-6 

-29 

-23 

082.6 

14.0 

100 

49 

N/A 

36 

10 

36 

-4 

-14 

-50 

260.0 

10.4 

1,000 

50 

Atalandi 

36 

0 

50 

-7 

-8 

-50 

087.6 

17.3 

100 

51 

Majestic  Maersk 

36 

19 

48 

-4 

-6 

-57 

252.9 

11.0 

100 

52 

STI  San 

35 

14 

30 

-5 

-25 

-49 

010.3 

9.2 

100 

53 

Cafer  Dede 

36 

19 

11 

-4 

-8 

-40 

253.2 

10.3 

100 

54 

Meridiaan 

35 

32 

51 

-5 

-8 

-57 

351.8 

5.5 

10,000 

55 

Spirit  of 

35 

0 

45 

-6 

-44 

-29 

051.9 

17.3 

100 

56 

Opal  Leader 

36 

32 

47 

-4 

-15 

-41 

239.0 

9.8 

100 

57 

Cape  Cee 

36 

14 

50 

-5 

-24 

-39 

163.4 

3.0 

100 

58 

Navin  Eagle 

36 

9 

7 

-4 

-10 

-2 

261.4 

9.0 

100 

59 

Arklow  Rover 

35 

59 

40 

-3 

-38 

-45 

272.7 

12.5 

1,000 

60 

Clipper  Star 
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Latitude 

Longitude 

Course 

Speed 

Score 

# 

Name 

degs 

mins  secs 

degs 

mins 

secs 

(degs) 

(knts) 

36 

13 

37 

-7 

-8 

-49 

099.1 

15.8 

100 

61 

N/A 

36 

10 

3 

-4 

-8 

-42 

264.0 

8.6 

100 

62 

Sealand  New 

36 

11 

43 

-3 

-58 

-15 

261.3 

9.9 

100 

63 

Waaldijk 

35 

58 

11 

-5 

-2 

-25 

262.1 

1.6 

100 

64 

Bosporusdiep 

35 

58 

43 

-4 

-39 

-41 

279.9 

4.6 

10,000 

65 

BSLE  Genova 

36 

15 

49 

-5 

-1 

-10 

231.6 

2.5 

100 

66 

Lone  Star 

36 

14 

51 

-4 

-6 

-14 

257.6 

7.7 

100 

67 

Antari 

36 

21 

15 

-4 

-1 

-58 

252.1 

8.3 

100 

68 

Neptune  Kefalonia 

36 

24 

21 

-3 

-7 

-21 

258.0 

12.9 

100 

69 

Cap  Felix 

35 

41 

58 

-6 

-47 

0 

078.7 

9.6 

100 

70 

Amavisti 

35 

54 

54 

-7 

-19 

-1 

084.8 

13.4 

100 

71 

N/A 

36 

27 

24 

-3 

-41 

-58 

252.0 

10.1 

100 

72 

Lada 

35 

42 

40 

-4 

-1 

-32 

288.6 

7.9 

100 

73 

Gremio 

35 

10 

29 

-5 

-46 

-8 

025.4 

7.5 

100 

74 

Laima  Uno 

35 

47 

10 

-8 

-21 

-36 

085.1 

19.5 

100 

75 

CMA  CGM 

36 

20 

40 

-3 

-33 

-26 

256.5 

9.8 

100 

76 

Atlantic  Moon 

36 

15 

36 

-3 

-31 

-25 

261.2 

9.7 

100 

77 

Umar  1 

36 

5 

8 

-4 

-27 

-41 

256.7 

4.1 

100 

78 

Paquito  Moreno 

35 

56 

9 

-7 

-11 

-14 

085.3 

12.2 

100 

79 

Ramform  Tethys 

36 

25 

57 

-3 

-38 

-45 

254.7 

10.1 

100 

80 

Maersk  Denver 

This  table  consists  of  all  COI’s  latitude  and  longitude  at  the  initial  reference  time, 
COI’s  course,  COI’s  speed,  scoring  obtained  for  visiting  that  COI,  reference  number 
in  the  list,  and  COI’s  name.  This  complete  list  of  COIs  corresponds  to  all  vessels 
transmitting  AIS  signal  in  the  Strait  of  Gibraltar  on  November  13,  2016,  starting  at 
midnight  and  ending  12  hours  later. 


E.  TUNING  THE  SCORING  PARAMETER 

We  need  to  define  the  scoring  parameter.  In  Figure  16  we  summarize  the 
scoring  for  route  planning.  We  establish  three  basic  levels  of  scoring  defined  as 
High,  Medium,  and  Low  priority,  which  captures  the  most  common  process 
based  on  personal  experience.  Note  that  maritime  situation  indicators  are 
present  at  all  times,  being  mostly  used  when  COI  AIS  data  is  not  available.  AIS 
discrepancy  arises  when  COI  AIS  data  does  not  match  with  behavior,  such  as 
heading  opposite  direction  to  the  port  of  destination,  or  other  data  incoherencies 
with  data  bases. 


24 


High  priority 


Medium  priority 


High  priority 


Medium  priority 


Low  priority 


Figure  16.  Rewarding  Structure. 


We  modify  the  score  of  each  COI  as  a  decreasing  function  in  time 
because  it  is  desired  to  visit  the  most  important  COIs  at  the  beginning  of  the 
route.  The  formula  for  ORCA  VT  is  the  following: 


score . .  =  base. 


w 


Km-(seqik+l)y 

where  baseih  is  fixed  for  each  node  based  on  its  priority,  seqik  is  the  ordinal 
position  of  node  i  in  COI  k,  and  w  is  the  total  number  of  time  windows.  The 
formula  for  ORCA  Tl  is  the  following: 

f  \ 


scorei,,,h  =baseiXh~ 


w 


100-  seqt 


where  seq,  is  the  ordinal  position  of  time  step  teT,  and  w  equals  in,  as  defined 
in  the  ORCA  Tl  formulation.  The  baseUl  and  baseih  values  respond  to  the  priority 
of  each  COI  and  is  shown  in  Table  2.  We  arbitrarily  select  four  high  priority  COIs 
(numbers  15,  25,  55,  and  65  in  Table  2)  with  an  initial  base  scoring  parameter  of 
10,000  points.  We  arbitrarily  select  four  medium  priority  COIs  (numbers  20,  30, 
50,  and  60)  with  an  initial  base  score  parameter  of  1 ,000  points.  Any  other  COI  in 
the  list  has  an  initial  base  scoring  of  100  points.  Because  it  is  better  to  visit  any 
COI  with  the  manned  helicopter,  we  only  give  half  of  any  COI  score  value  to  the 

UAVs,  denoting  the  preference  for  helicopters  when  they  are  available. 
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V.  ELIMINATING  ARCS 


A.  INTRODUCTION 

This  chapter  develops  constraints  to  eliminate  transitions  or  combinations 
of  transitions  between  locations  in  either  model  for  any  asset’s  route.  Its  inclusion 
may  eliminate  arcs  that  could  be  part  of  an  optimal  route  for  an  asset.  As  such,  it 
should  be  considered  a  heuristic.  That  said,  it  is  motivated  by  some  properties  of 
TSP  tours  that  we  develop  in  the  following  text. 

B.  CONVERTING  A  TOUR  INTO  A  CIRCLE 

Dantzig  et  al.  (1954)  show  an  optimal  tour  to  a  TSP  that  minimizes 
distance  traveled  between  49  cities  taking  road  distances  from  an  atlas  (Figure 
17).  The  tour  visits  all  cities  exactly  once  with  no  subtours. 


Figure  17.  The  Optimal  Tour  of  49  Cities.  Source:  Dantzig  et  al.  (1954). 
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We  use  the  optimal  tour  identified  by  Dantzig  et  al.  (1954)  as  motivation. 
Consider  the  following  sketch  (Figure  18)  and  assume: 

•  all  nodes  are  located  into  a  2-dimensional  plane; 

•  all  distances  are  straight  lines  (a  Euclidean  TSP);  and 

•  all  nodes  are  connected  as  in  a  TSP  optimal  solution. 

Given  an  optimal  tour,  we  can  place  nodes  on  the  circumference  of  a  circle  such 
that  there  is  a  node  for  each  node  of  the  TSP,  and  the  nodes  are  ordered  such 
that  the  distance  between  two  adjacent  nodes  is  the  same  as  in  the  optimal  tour 
(Figure  18).  We  call  this  circle  the  mass  circle.  Let  us  define  the  mass  radius 
(rmass)  as  the  radius  of  the  mass  circle.  Then,  we  can  apply  the  geometry 
expressed  in  Figure  19. 


Figure  1 8.  Relocation  of  a  Tour  into  a  Circle. 
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Figure  19.  Arc  Relocation  into  the  Mass  Circle. 


In  equation  (4.1),  we  do  a  simple  trigonometric  derivation  using  the  sine 
function.  Equations  (4.2),  (4.3),  and  (4.4)  follow  by  algebra.  Equation  (4.5)  is 
obvious  since  the  tour  is  complete.  Following  the  same  logic  in  all  segments  as  in 
the  case  of  d12,  by  addition,  we  obtain  equation  (4.6).  By  algebra  and  substitution, 
equation  (4.7)  follows. 

1.  Computational  Benefits 

Given  any  feasible  tour,  we  can  calculate  rmass  for  this  tour,  and  eliminate 
any  arc  where  (dij  /  2  rmass)  >  1  (exceeds  diameter  of  the  circle)  because  arcsin(x ) 
does  not  exist  for  any  *  >  1,  and  rmass  <  rmass  (where  r*mass  is  the  radius  for  an 
optimal  tour).  As  an  example,  see  the  black  irregular  pentagon  (Figure  20).  If  we 
relocate  the  nodes  in  a  circle,  in  the  same  order  and  same  distances  between 
consecutive  nodes,  we  obtain  the  blue  tour,  and  we  see  that  the  radius  of  the 
circle  is  rmass  =  5.34  (by  approximation).  Distance  d2,4  =  11  (in  the  original  tour), 
and  (d2 4  /  2  rmass)  >  1-  Therefore,  its  arcsine  does  not  exist,  and  it  can  be 
disregarded. 
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Figure  20.  Left:  y  =  arc  sin  (.*).  Source:  Desmos  (2017); 

Right:  A  Non-Optimal  Arc. 


2.  Using  the  Air  Assets  Endurance  as  an  Upper  Bound 


This  property  can  be  used  in  any  tour,  where  the  total  distance  is  limited 
by  some  endurance.  In  this  thesis,  distances  between  COIs  are  known 
parameters  at  any  time,  an  air  asset’s  speed  is  constant,  and  its  endurance  is 
limited.  Therefore,  the  total  distance  is  bounded  by  an  air  asset’s  endurance. 


z 
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\i,j)  e  optimal 
tour 


arcsin 


d.. 


2-r 

V  mass  J 


—  n 
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r  > 
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2  K 


Z 
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(i,j)  e  optimal 
tour 
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(i-j)s.t. 
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(i,j)  s.t. 
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y  tour 


>  n 
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Then,  there  exists  a  parameter  8  such  that: 


f 


z 


arc  sin 


(i,j)  s.t. 
(i,j)  e  optimal 
tour 


*-dV 


I 


(/,;)  s.t. 

(/,_/)  e  optimal 

tour  j 


<7t  +  8 


(4.8) 


Since  this  thesis  refers  to  air  assets  moving  at  a  constant  speed,  we 
assume  that  the  time  tq  to  fly  from  COI  i  to  COI  j  is  proportional  to  the  distance, 
and  since  the  air  asset  has  a  limited  endurance  z-max ,  we  may  write  the  following 
constraint  (with  8  big  enough): 


arcsin 


(n'T^ 
V  Tnax  J 


•  Xif  <71  +  8 


(4.9) 


The  ORCA  VT  formulation  depends  on  the  maximum  endurance  of  each 
air  asset  type  and  a  moving  mother  warship.  If  we  consider  a  scenario  where  an 
air  asset  flies  a  long  arc  ahead  of  the  mother  warship,  which  increases  speed  to 
retake  it,  we  might  include  the  time  that  the  air  asset  takes  to  fly  from  the  initial 
position  of  the  mother  warship  (1)  to  its  final  position  rhWth  ,  (weWh).  This  slightly 
increases  the  denominator  and  it  is  a  more  conservative  approach,  using  8  to 
adjust  the  proximity  to  n.  Hence,  the  heuristic  constraints  for  ORCA  VT  are: 


y)  arcsin 

ij 


(  n.z  ' 

V  rmax  +  h,W,h  J 


■X 


',j,h 


<71+8 


Vh  (4.10) 


Letting  ai  jh 


=  arcsin 


n-T, 


i,j,h 


yrmax“*“  T.m'./i  J 


,  we  get 


V/t  (4.11) 


In  constraint  set  (4.1 1),  we  consider  that  the  air  asset  is  moving  following 
a  circumference  of  length  rmax  +  r hWih  .  If  the  time  is  small  in  relation  to  the 
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endurance,  using  constraints  (4.11)  is  similar  (but  not  identical)  to  using  a 
constraint  adding  times  TUj,h  (4.12). 

^  j  h  ■  Xt  .  A  <  air  asset  endurance  ,  V/i  (4.12) 

ij 

In  constraint  set  (4.11),  we  are  adding  parameters  that  follow  a  nonlinear 
distribution  (using  the  arcsine  function),  while  simply  adding  the  times  tljM  (4.12) 
follows  a  linear  one  (all  speeds  are  constant).  This  difference  provides  added 
restrictions  as  time  increases  (see  next  section). 

3.  Heuristic  Limitations 

Figure  21  shows  data  for  all  80  COIs  and  a  subset  of  20  COIs.  For  80 
COIs,  we  see  a  bigger  dispersion  of  COIs.  COI  #  2  in  its  last  position  is  outlined 
in  white  in  Figure  21 .  If  we  try  to  visit  it  coming  from  the  opposite  side,  the  time  is 
substantial  in  relation  to  the  air  asset’s  endurance  and  is  eliminated  by  constraint 
set  (4.11).  It  is  unlikely  (but  not  impossible  given  COI  weighting)  to  obtain  an 
optimal  solution  that  includes  this  kind  of  arc.  For  example,  if  we  only  have  two 
high  priority  COIs,  and  they  are  in  opposite  extreme  positions  from  the  mother 
warship,  we  may  require  such  arcs  for  an  optimal  route. 
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Figure  21 .  Set  of  80  COIs  (top)  and  Set  of  20  COIs  (bottom). 

Adapted  from  Google  Earth  (2016). 

Figures  22  and  23  show  the  distributions  of  the  arcsines  aitjih  and  the  times 
Tij'h  .  In  both  figures,  we  normalize  the  time  value  of  each  arc  TiJ:h  by  using  a 
factor  (n  /  r  max)  to  facilitate  the  comparison  with  the  arcsine  distribution. 
Whenever  the  value  of  the  quotient  n  TiJih  /  (z-max  +  z\,w,h )  is  greater  than  1,  we 
assign  to  aiJih  the  value  of  4,  to  denote  that  the  arcsine  function  would  not  exist, 
and  to  ensure  that  this  arc  does  not  satisfy  constraint  set  (4.11).  We  use  the 
letters  A,  B,  C,  and  D  to  denote  ranges  of  the  distributions  that  we  use  to  count 
the  number  of  arcs  eliminated  and  help  in  the  discussion.  The  ranges  of  interest 
are  B  and  C  because  this  is  where  constraint  sets  4.1 1  and  4.12  differ. 
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Figure  22.  Data  Distribution  Plots  (20  COIs  and  10  Time  Windows). 

For  20  COIs  (Figure  22),  we  see  a  small  number  of  arcs  in  ranges  B  and 
C.  By  inspection,  the  difference  between  the  times  t iJ>h  and  the  values  of  the 
arcsines  aiJth  are  not  significant,  especially  in  range  C,  because  there  are  no  long 
arcs  in  relation  to  the  air  assets’  endurance. 


Figure  23.  Data  Distribution  Plots  (80  COIs  and  10  Time  Windows). 

For  80  COIs  (Figure  23),  we  see  that  the  number  of  arcs  that  we  eliminate 
(D)  is  significant.  We  would  also  eliminate  these  arcs  by  using  a  time  constraint 
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set  (4.12).  However,  using  the  heuristic,  we  eliminate  most  of  the  longest  feasible 
arcs  (C)  and  we  penalize  the  use  of  the  arcs  in  B.  In  Tables  3  and  4,  we 
summarize  all  data  for  Figures  22  and  23. 


Table  3.  Data  Distribution  Summary  (20  COIs  and  10  Time  Windows). 


Asset 

Helicopter 

UAVs 

Type 

range  (ry,*) 

#  arcs 

% 

range  (r  ,,,,*) 

#  arcs 

% 

A 

0.00-0.43 

39,280 

89.07  * 

0.00-1.12 

42,354 

96.04  * 

B 

0.43-0.96 

4,800 

10.88  * 

1.12-1.99 

1,732 

3.92  * 

C 

0.96-1.11 

20 

0.04  * 

1.99-2.99 

14 

0.03  * 

ABC 

0.00-1.11 

44,100 

100  ** 

0.00-2.99 

44,100 

100  ** 

D 

- 

0 

0  ** 

2.99-6.24 

0 

0  ** 

ABCD 

0.00-1.11 

44,100 

- 

0.00-6.29 

44,100 

- 

Table  4.  Data  Distribution  Summary  (80  COIs  and  10  Time  Windows). 


Asset 

Helicopter 

UAVs 

Type 

range  (zu,h) 

#  arcs 

% 

range  (zUM) 

#  arcs 

% 

A 

0.00-0.43 

339,620 

52.98  * 

0.00-1.12 

420,860 

65.66  * 

B 

0.43-0.96 

234,934 

36.65  * 

1.12-1.99 

159,994 

24.96  * 

C 

0.96-1.49 

66,406 

10.36  * 

1.99-2.99 

66,406 

9.37  * 

ABC 

0.00-1.49 

640,960 

97.69  ** 

0.00-2.99 

640,960 

97.69  ** 

D 

1.49-3.12 

15,140 

2.30  ** 

2.99-6.24 

15,140 

2.30  ** 

ABCD 

0.00-3.12 

656,100 

- 

0.00-6.29 

656,100 

- 

A:  Included  with  or  without  heuristic 
B:  Higher  value  with  the  heuristic 
C:  Arcs  eliminated  with  the  heuristic 

D:  Infeasible  arcs  (flight  time  is  greater  than  half  of  the  endurance) 
*  Percentage  of  arcs  included  in  A,  B,  and  C 
**  Percentage  of  all  arcs 


In  the  subset  of  20  COIs  (Table  3),  the  percentage  of  arcs  where  the 
heuristic  can  help  is  small  for  both  helicopters  and  UAVs:  very  small  in  range  C 
(almost  zero),  about  11%  and  4%  in  range  B,  and  zero  in  range  D.  For  80  COIs 
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(Table  4),  about  10%  of  the  arcs  are  in  Section  C,  30%  in  Section  B,  and  just 
over  2%  in  Section  D. 

If  there  is  a  big  number  of  nodes,  such  as  the  number  of  COIs  multiplied 
by  the  number  of  time  windows,  eliminating  arcs  helps  to  obtain  a  solution  faster. 
For  80  COIs  and  20  time  windows,  the  number  of  constraints  in  (3.6)  is 
10,497,600  (812-202-4),  which  is  a  challenging  number.  Eliminating  10%  of  the 
arcs  (Section  C)  plus  a  nonlinear  penalty  in  30%  of  the  arcs  (Section  B)  helps  to 
obtain  a  solution.  If  COIs  were  more  dispersed,  and  the  visiting  routes  were  more 
challenging  for  the  air  assets  because  transition  times  are  longer,  then,  by  using 
this  heuristic,  we  would  eliminate  a  greater  number  of  arcs  because  there  would 
be  more  arcs  in  Sections  B,  C  and  D.  If  we  pursue  a  good  solution  for  a  big 
problem  instance  in  a  reasonable  time  limit,  we  may  want  to  include  this  heuristic 
as  a  decision  between  having  this  or  having  no  solution  at  all. 
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VI.  PROBLEM  IMPLEMENTATION  AND  RESULTS 


A.  INTRODUCTION 

This  chapter  shows  ORCA  impiementations  of  data  described  in  Chapter 
IV  and  compares  results  for  both  ORCA  ILPs.  We  use  a  2.5  GHz  Intel(R) 
Core(TM)  i5-6300U  Microsoft  Surface  running  Windows  10  PRO.  We  use  Python 
2.7.13  to  prepare  data.  We  employ  GAMS  24.8.2  (2017)  with  the  CPLEX  solver 
version  12.7.0.0  (2017)  to  generate  and  solve  ILP  instances.  We  use  Google 
Earth  (2017)  to  show  some  routing  graph  solution.  We  use  R  version  3.3.2 
(2016)  to  plot  time  distributions. 

For  both  the  ORCA  VT  and  Tl  ILP  formulations,  we  run  the  following  tests 
(Table  5)  using  four  air  assets  (1  SH60  plus  3  UAVs),  different  subsets  of  COIs, 
and  different  numbers  of  time  windows  (ORCA  VT)  or  time  steps  (ORCA  Tl).  We 
consider  a  typical  scenario  to  be  between  20  to  40  COIs,  and  80  COIs  to  be  a 
maximum  that  would  rarely  be  encountered. 


Table  5.  Test  Structure. 


#  COIs 

ORCA  VT 

#  time  windows 

ORCA  Tl 
#  time  steps 

20 

5,10,15,20 

5,10,15,20 

40 

5,10,15,20 

5,10,15,20 

80 

5,10,15,20 

5,10,15,20 

20  COIs  subset  includes  COIs  from  number  30  to  number  49  in  Table  2. 

40  COIs  subset  includes  COIs  from  number  20  to  number  59  in  Table  2. 

80  COIs  set  is  the  complete  Table  2. 

The  larger  the  number  of  time  windows,  the  more  precise  the  route  will  be. 
This  number  in  the  first  formulation  is  limited  by  a  constraint  (3.6)  which  is  0(n2), 
where  n  is  the  product  of  the  number  of  COIs  and  the  number  of  time  windows. 
Instances  using  the  second  formulation  have  a  similar  number  of  constraints  but 
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a  smaller  number  of  feasible  arcs,  although  they  require  a  larger  number  of  time 
steps  to  be  effective.  Balancing  the  number  of  COIs  and  the  number  of  time 
windows  is  a  critical  requirement  to  obtain  acceptable  solutions  in  a  reasonable 
amount  of  time.  First,  we  show  results  for  both  formulations  as  presented  in 
Chapter  III.  Thereafter,  and  to  speed  solution  time,  we  heuristically  solve  both 
formulations  for  one  air  asset  at  a  time.  Finally,  we  also  use  the  heuristic  arc 
elimination  (Chapter  V)  in  addition  to  solving  for  one  air  asset  at  a  time  only  for 
the  ORCA  VT  formulation. 

B.  RESULTS  WITHOUT  HEURISTICS 

We  show  results  of  the  ORCA  VT  and  Tl  formulations  (Tables  6  and  7) 
without  heuristic  additions  and  with  a  runtime  limit  of  30  minutes  (we  consider  30 
minutes  a  reasonable  time  to  get  ready  onboard  while  preparing  to  execute  flying 
operations).  For  example,  the  first  line  in  Table  6  shows  a  solution  to  the  ORCA 
VT  program  with  the  set  of  20  COIs  with  5  time  windows  (105  nodes).  The  time 
limit  (reslim)  to  solve  the  problem  is  1,800  seconds,  although  the  solver  takes 
only  1,307.6  seconds  to  reach  a  relative  gap  (best  integer  solution  quality)  of 
0.26%  for  an  optimality  stopping  condition  of  0.5%  (optcr).  The  solution  shows 
that  the  helicopter  visits  20  COIs  within  its  endurance  and  we  use  no  UAVs, 
obtaining  a  total  score  objective  function  value  of  2,991.9.  All  other  rows  are 
similar  except  when  displaying  the  number  of  COIs  visited  by  each  UAV.  This  is 
recorded  as  a  +  and  the  number  under  the  “#  COIs  visited”  column. 
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Table  6.  ORCA  VT  Program  Outcomes. 


# 

COIs 

# 

TW 

Runtime 

(seconds) 

Rel. 

gap 

(%) 

optcr 

(%) 

reslim 

(secs) 

#  COIs 
visited 

Total 

COIs 

Visited 

Objective 

Function 

Value 

20 

5 

1,307.6 

0.26 

0.5 

1,800 

20 

20 

2,991.9 

10 

1,800.0 

0.66 

0.5 

1,800 

20 

20 

2,979.8 

15 

1,800.1 

0.96 

0.5 

1,800 

20 

20 

2,967.8 

20 

1,800.1 

6.24 

0.5 

1,800 

17+2+1 

20 

2,805.7 

40 

5 

1,800.3 

1.82 

1.0 

1,800 

31+5+3+1 

40 

26,114.4 

10 

1,800.1 

10.56 

1.0 

1,800 

14+11+13 

38 

23,788.8 

15 

1,800.1 

43.96 

1.0 

1,800 

15+1+10+5 

31 

14,904.3 

20 

1,800.3 

51.40 

1.0 

1,800 

5+5+1 +8 

19 

12,900.7 

80 

5 

1,801.1 

79.24 

1.0 

1,800 

5+1 +1+1 

8 

10,645.9 

10 

1,800.1 

99.33 

1.0 

1,800 

1+1+1+1 

4 

342.1 

15 

1,800.3 

99.93 

1.0 

1,800 

1+1+1+1 

4 

1,231.8 

20 

no  solution 

- 

1.0 

1,800 

- 

- 

- 

Table  7.  ORCA  Tl  Program  Outcomes. 


# 

COIs 

#  time 
steps 

Runtime 

(Secs) 

Rel. 

gap 

(%) 

optcr 

(%) 

reslim 

(secs) 

#  COIs 
visited 

Total 

COIs 

Visited 

Obj. 

Funct. 

Value 

20 

5 

0.28 

0.00 

0.5 

1,800 

1 +3+3+3 

10 

1,700.2 

10 

0.67 

0.00 

0.5 

1,800 

3+4+5+8 

20 

2,300.6 

15 

3.67 

0.00 

0.5 

1,800 

6+4+10 

20 

2,450.2 

20 

4.28 

0.00 

0.5 

1,800 

8+1+11 

20 

2,549.6 

40 

5 

0.42 

0.00 

1.0 

1,800 

1 +3+3+3 

10 

17,000.2 

10 

4.27 

0.00 

1.0 

1,800 

S+8+8+8 

27 

23,350.8 

15 

37.9 

0.00 

1.0 

1,800 

6+10+12+12 

40 

25,051.6 

20 

77.7 

0.00 

1.0 

1,800 

8+10+6+16 

40 

25,151.6 

80 

5 

1.39 

0.00 

1.0 

1,800 

1 +3+3+3 

10 

27,350.2 

10 

25.5 

0.00 

1.0 

1,800 

S+8+8+8 

27 

38,200.8 

15 

398.4 

0.00 

1.0 

1,800 

6+13+13+13 

45 

45,102.1 

20 

no  solution 

- 

1.0 

1,800 

- 

- 

- 

Table  7,  shows  results  using  the  ORCA  Tl  formulation  following  the  same 
format  as  Table  6.  Comparing  solutions  from  Tables  6  and  7,  we  see  that  the 
ORCA  Tl  formulation  is  much  faster  in  all  the  subsets  of  COIs  but  the  quality  of 
its  solutions  is  directly  impacted  by  the  number  of  time  windows.  For  20  COIs,  we 
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see  that  the  ORCA  VT  formulation  uses  one  air  asset  with  5,  10,  and  15  time 
windows  and  achieves  a  greater  reward  for  using  the  helicopter,  while  the  Tl 
needs  more  than  one  air  asset. 

For  80  COIs,  the  VT  formulation  fails  even  if  we  increase  the  runtime  to 
one  hour  (Table  8),  while  the  ORCA  Tl  is  limited  by  the  number  of  time  windows. 


Table  8.  ORCA  VT-TI  Outcomes  Comparison  (Increased  Runtime). 


# 

COIs 

#  TW 
/steps 

Runtime 

(Secs) 

Rel. 

gap 

(%) 

optcr 

(%) 

reslim 

(secs) 

#  COIs 
visited 

Total 

COIs 

Visited 

Obj. 

Funct. 

Value 

80 

20 

no  solution 

- 

1.0 

3,600 

- 

- 

- 

20 

3,600.5 

2.57 

1.0 

3,600 

7+17+17+13 

54 

45,603.4 

First  row  is  for  ORCA  VT  without  heuristics. 
Second  row  is  for  ORCA  Tl  without  heuristics. 


C.  RESULTS  WITH  LOOPING  HEURISTIC 

To  speed  solution  time  and  improve  results,  we  use  a  heuristic  that  solves 
for  each  air  asset  one  at  a  time.  We  first  solve  for  the  helicopter,  fix  its  solution, 
and  then  solve  for  one  of  the  UAVs,  fix  its  solution,  and  so  on.  Because  the 
helicopter  is  the  preferred  air  asset,  we  start  with  it.  We  limit  the  runtime  for  the 
helicopter  to  1,200  seconds,  and  to  200  seconds  for  each  one  of  the  UAVs,  to 
continue  within  a  reasonable  total  time  limit  of  30  minutes.  In  Table  9,  we  show 
results  for  ORCA  VT  using  this  heuristic.  For  each  time  window  scenario,  we 
specify  the  results  for  each  iteration  (up  to  four  iterations  for  the  four  air  assets). 
For  example,  for  40  COIs  (Table  9)  and  15  time  windows,  the  helicopter  visits  24 
COIs,  obtaining  a  total  score  of  24,034.8,  and  the  first  UAV  visits  16  COIs, 
adding  only  1 ,21 6.0.  Together  they  obtain  a  total  score  of  25,250.8. 

In  Table  10,  we  show  results  for  ORCA  Tl  using  this  looping  heuristic. 
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Table  9.  ORCA  VT  Program  Outcomes  with  a  Looping  Heuristic. 


# 

COIs 

# 

TW 

Runtime 

(seconds) 

Rel. 

gap 

(%) 

optcr 

(%) 

reslim 

(secs) 

#  COIs 
visited 

Total 

COIs 

Visited 

Objective 

Function 

Value 

15 

1,142.8 

0.96 

1.0 

1,200 

20 

20 

2,967.8 

41 U 

20 

1,200.3 

1.58 

1.0 

1,200 

20 

20 

2,944.7 

1  ^ 

1,200.6 

9.61 

1.0 

1,200 

24 

An 

24,034.8 

/in 

201.1 

0.10 

0.1 

200 

16 

25,250.8 

90 

1,201.1 

5.64 

1.0 

1,200 

26 

An 

25,087.7 

41U 

1,75.8 

0.09 

0.1 

200 

14 

25,739.7 

1,202.4 

99.61 

1.0 

1,200 

1 

196.8 

204.1 

99.93 

0.1 

200 

1 

A 

243.8 

1  O 

206.0 

99.92 

0.1 

200 

1 

291.8 

an 

207.9 

99.91 

0.1 

200 

1 

338.8 

oU 

1,204.4 

99.61 

1.0 

1,200 

1 

198.7 

90 

207.3 

99.95 

0.1 

200 

1 

A 

242.2 

211.6 

99.94 

0.1 

200 

1 

285.2 

217.3 

99.93 

0.1 

200 

1 

333.7 

Table  1 0.  ORCA  Tl  Program  Outcomes  with  a  Looping  Heuristic. 
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We  see  that  using  a  looping  heuristic  (and  fixing  variables)  improves  both 
formulations  by  decreasing  the  runtime  and  reducing  the  number  of  air  assets 
employed  in  the  solution.  However,  ORCA  VT  is  still  slow  in  relation  to  the  Tl 
formulation,  although  it  still  wins  in  the  score  of  the  20  time  windows  and  uses 
only  one  air  asset.  In  the  40  COIs  subset,  ORCA  Tl  uses  one  or  two  more  air 
assets  than  ORCA  VT,  although  Tl  performs  reasonably  well  in  the  set  of  80 
COIs  (less  than  two  minutes  in  the  last  instance),  while  the  ORCA  VT  always 
terminates  due  to  a  time  limit. 

D.  RESULTS  WITH  LOOPING  HEURISTIC  AND  ARC  ELIMINATION 

To  speed  solution  time,  we  consider  the  arc  elimination  heuristic  combined 
with  the  looping  heuristic  from  the  previous  section.  In  the  subsets  of  20  and  40 
COIs,  the  looping  heuristic  produces  a  solution  in  less  than  half  an  hour.  Hence, 
here  we  focus  in  the  set  of  80  COIs  and  a  longer  runtime  of  two  hours.  Since 
ORCA  Tl  is  limited  by  the  number  of  time  steps  and  it  obtains  quickly  for  all 
instances,  we  focus  only  on  ORCA  VT  with  1 5  and  20  time  windows  (Table  1 1 ). 


Table  1 1 .  ORCA  VT  with  a  Looping  Heuristic  and  Arcs  Elimination. 


# 

COIs 

#  TW 

Runtime 

(secs) 

Rel. 

gap 

(%) 

optcr 

(%) 

reslim 

(secs) 

#  COIs 
visited 

Total 

COIs 

Visited 

Objective 

Function 

Value 

3,604.5 

34.18 

1.0 

3,600 

20 

33,469.8 

1,206.3 

4.26 

0.1 

1,200 

23 

7R 

40,404.1 

1  O 

1,207.5 

1.82 

0.1 

1,200 

21 

(  O 

41,392.1 

on 

1,209.5 

0.26 

0.1 

1,200 

11 

41,917.1 

OU 

3,608.9 

13.82 

1.0 

3,600 

25 

43,823.9 

9  n 

1,211.8 

3.33 

0.1 

1,200 

23 

77 

45,780.9 

c.  U 

1,216.6 

1.39 

0.1 

1,200 

18 

/  / 

46,588.4 

557.8 

0.08 

0.1 

1,200 

11 

47,082.9 

Using  this  combination  of  heuristics,  ORCA  VT  obtains  the  highest  reward 
visiting  77  COIs.  It  performs  well  in  both  time  window  scenarios  and  even  better 
in  the  case  with  more  time  windows,  and  5  equal  to  0.00001.  In  Tables  12  and 
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13,  we  show  equivalent  experiments  with  the  same  runtime  (2  hours)  and  the 
same  number  of  time  windows. 


Table  12.  ORCA  VT  with  a  Looping  Heuristic  Only  (Increased 

Runtime). 


# 

COIs 

#  TW 

Runtime 

(secs) 

Rel. 

gap 

(%) 

optcr 

(%) 

reslim 

(secs) 

#  COIs 
visited 

Total 

COIs 

Visited 

Objective 

Function 

Value 

3,602.4 

99.61 

1.0 

3,600 

1 

196.8 

1  R 

1,204.1 

58.53 

0.1 

1,200 

12 

10,667.4 

1  O 

1,207.0 

10.45 

0.1 

1,200 

23 

OO 

23,005.8 

on 

1,208.2 

5.01 

0.1 

1,200 

19 

24,344.8 

oU 

3,604.3 

97.46 

1.0 

3,600 

4 

1,299.9 

on 

1,207.5 

50.63 

0.1 

1,200 

18 

RQ 

12,938.4 

1,211.6 

7.43 

0.1 

1,200 

15 

DO 

24,193.4 

1,218.8 

3.91 

0.1 

1,200 

21 

24,948.7 

With  only  the  looping  heuristic  and  increased  runtime  (Table  12),  we  see 
the  value  of  using  the  arc  elimination  constraint  set.  In  the  first  loop  with  20  time 
windows,  the  helicopter  only  visits  4  COIs  with  the  looping  heuristic  only 
compared  with  25  COIs  when  using  both  the  looping  heuristic  plus  the  arc 
elimination  constraint  set. 

Without  using  any  heuristic  with  20  time  windows  (Table  13),  no  solution  is 
found  even  when  given  two  hours. 


Table  13.  ORCA  VT  Outcomes  (Increased  Runtime). 


# 

COIs 

#  TW 

Runtime 

(secs) 

Rel. 

gap 

(%) 

optcr 

(%) 

reslim 

(secs) 

#  COIs 
visited 

Total 

COIs 

Visited 

Objective 

Function 

Value 

80 

15 

7,210.0 

57.76 

0.5 

7,200 

5+1 +7+1 

14 

21,666.8 

20 

no  solution 

- 

0.5 

7,200 

- 

- 

- 

In  Figure  24,  we  show  a  plot  of  the  routes  corresponding  to  the  second 
row  of  Table  1 1  (visiting  77  COIs). 


43 


Red,  yellow,  blue,  and  green  routes  correspond  to  the  helicopter,  and  UAVs  1,  2 
and  3. 

Figure  24.  Routes  of  Four  Air  Assets  Visiting  77  COIs. 


Figure  25.  Single  Routes  of  Four  Air  Assets  Visiting  77  COIs. 
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VII.  CONCLUSIONS  AND  OPPORTUNITIES 


A.  SUMMARY 

Currently,  the  Tactical  Action  Officer  (TAO)  and  the  Air  Asset  or  Helicopter 
Controller  (HCO)  route  air  assets  based  on  their  best  understanding  of  the 
surface  tactical  picture  without  any  decision  aids.  We  need  a  tool  to  help  them, 
and  this  thesis  presents  and  tests  the  ORCA  problem  as  a  prototype  for  such  a 
tool.  Two  different  formulations  of  the  ORCA  problem  recommend  routes  for 
visiting  prioritized  COIs  at  sea.  ORCA  Tl  is  faster  but,  at  times,  requires  more  air 
assets  to  visit  the  same  number  of  COIs.  ORCA  VT  is  generally  slower  but 
performs  better  with  a  small  number  of  time  windows  and  provides  the  best 
results  when  given  more  time. 

We  recommend  using  ORCA  VT  if  the  number  of  COIs  is  small  (e.g.,  20 
COIs),  there  is  a  reasonable  time  to  find  an  optimal  route  (e.g.,  30  minutes),  and 
we  want  to  employ  the  smallest  possible  number  of  air  assets.  We  recommend 
using  ORCA  Tl  if  the  number  of  COIs  is  small  (e.g.,  20  COIs),  the  time  available 
to  find  an  optimal  route  is  short  (e.g.,  less  than  2  minutes),  and  minimizing  the 
number  of  employed  air  assets  is  of  less  concern. 

When  the  number  of  COIs  is  intermediate  (e.g.,  40  COIs),  the  looping 
heuristic  is  effective  in  both  ORCA  VT  and  Tl.  Again,  ORCA  VT  uses  fewer  air 
assets  but  takes  more  time  to  obtain  a  solution  than  ORCA  Tl.  Both  formulations 
perform  well  within  a  time  limit  of  30  minutes. 

When  the  number  of  COIs  is  big  (e.g.,  80  COIs)  and  there  is  a  long  time  to 
plan  air  asset  routes,  ORCA  VT  with  both  heuristics  (looping  and  arc  elimination) 
is  the  best  option.  In  less  than  two  hours  of  runtime,  ORCA  VT  obtains  routes 
that  visit  as  many  as  77  COIs.  If  we  need  a  quick  solution,  we  recommend  using 
ORCA  Tl.  This  formulation  defines  routes  to  visit  up  to  61  COIs  in  less  than  1 
minute  by  using  just  the  looping  heuristic. 
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B.  FUTURE  OPPORTUNITIES 


Many  extensions  of  the  ORCA  formulations  may  prove  useful.  First,  we 
suggest  including  modifications  to  change  initial  positions  of  air  assets,  allowing 
dynamic  retasking  of  air  assets  while  already  flying.  Second,  we  may  look  for 
other  heuristics  that  improve  results  and  obtain  faster  solutions.  Here,  some 
deeper  research  in  the  arc  elimination  heuristic  may  be  worthwhile,  including 
testing  more  aggressive  deletion  rules. 

Routing  scenarios  at  sea  vary  greatly.  ORCA  is  required  to  manage  sets 
of  COIs  that  differ  widely  in  number,  speeds,  and  dispersion.  It  would  be  good  to 
test  the  effectiveness  of  ORCA  solutions  by  comparing  them  to  real-time  routing 
scenarios  aboard.  More  testing  under  different  scenarios  may  help  find  other 
useful  heuristics.  In  addition: 

•  Including  ORCA  within  a  combat  system  aboard  warships  is  the 
most  interesting  future  opportunity.  We  may  require  algorithms  to 
check  positions  of  COIs  to  correct  the  variability  produced  by  small 
course  and  speed  changes,  as  well  as  the  influence  of  wind.  This 
would  allow  air  asset  routes  to  be  adjusted  based  on  updated 
information. 

•  Planning  multiple  coordinated  mother  warships  to  identify  COIs  in  a 
larger  area  (e.g.,  the  Gulf  of  Aden)  is  a  natural  extension.  If  ships 
are  sharing  information  using  link  data  nets,  we  may  have  enough 
time  to  calculate  multiple  routes  for  multiple  air  assets  leaving  from 
multiple  warships  by  using  shared  data  from  other  warships,  air 
units,  satellite,  and  shore  stations. 

•  The  ORCA  ILPs  could  be  applied  also  for  routing  small  patrol 
boats.  We  could  integrate  them  on  radar  consoles.  Operators  could 
calculate  best  navigation  paths  to  identify  surface  contacts  by  using 
a  single  or  a  coordinated  group  of  multiple  patrol  boats. 

•  Another  extension  would  be  producing  a  sequential  weapons 
employment  plan.  We  may  adapt  ORCA  to  manage  weapon 
systems  instead  of  air  assets,  rewarding  the  destruction  of  threats 
instead  of  visiting  COIs,  while  we  have  threats  that  vary  in  risk 
instead  of  COIs  that  vary  in  position.  We  should  find  how  to  define 
the  risk  variation  as  a  function  of  time,  and  the  transit  time  between 
threats  for  each  weapon  system,  including  both  of  them  as  data  for 
the  problem. 
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GAMS  (2017)  with  the  CPLEX  solver  (2017)  obtains  good 
solutions,  but  there  are  free  software  opportunities  like  Pyomo 
(2017)  for  Python  (2017)  that  may  work  to  develop  the  ORCA  ILPs. 
By  doing  so,  we  would  not  need  to  employ  one  programming 
language  to  prepare  data  and  a  different  language  to  run  the  solver. 


47 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


48 


LIST  OF  REFERENCES 


Armada  Espanola.  n.d.  “SH-60B  Block  I  Core  B  LAMPS  III  -  10a  Escuadrilla 
Aeronaves.”  Retrieved  March  17,  2017.  http://www.armada.mde.es/ 
ArmadaPortal/page/Portal/ArmadaEspannola/buques_aeronaves/ 
prefLang_es/02_flotilla-aeronaves-helicopteros-04_1 0-escuadrilla- 
aeronaves-sh-60-b-lamps-iii. 

Balas,  Egon.  1989.  “The  Prize  Collecting  Travelling  Salesman  Problem.” 
Networks,  19.  doi:  1 0.1 002/net.32301 90602. 

Brown,  Gerald  G.  and  W.  Matthew  Carlyle.  2008.  “Optimizing  the  U.S.  Navy’s 
Combat  Logistics  Force,”  Naval  Research  Logistics  55:  800-810.  doi: 
10.1002/nav.20318. 

Calfee,  Sharif  H.  2003.  “Autonomous  Agent-Based  Simulation  of  an  AEGIS 

Cruiser  Combat  Information  Center  Performing  Battle  Group  Air-Defense 
Commander  Operations.”  Master’s  thesis,  Naval  Postgraduate  School. 

Commander,  U.S.  Pacific  Fleet.  Malabar  2015  Kicks  Off  With  Air  Defense 

Exercise.  Retrieved  March  17,  2017.  http://www.cpf.navy.mil/news.aspx/ 
030611. 

Dantzig,  George  B.,  Delbert  R.  Fulkerson,  and  Selmer  M.  Johnson.  1954. 
“Solution  of  a  Large-Scale  Traveling-Salesman  Problem,”  Operations 
Research  2:  393-410.  Doi:  10.1007/978-3-540-68279-0_1 . 

Department  of  the  Navy.  “Aegis  Ashore  Team  Trainer  Pilot  Class  Graduates.” 
CHIPS.  Retrieved  March  17,  2017.  http://www.doncio.navy.mil/CHIPS/ 
ArticleDetails.aspx?ID=6090. 

Department  of  the  Navy.  2015.  “SH-60  Sea  Hawk.”  Last  modified  August  21. 
http://www.navy.mi!/navydata/fact_display.asp?cid=1200&tid=500&ct=1. 

Desmos.  2017.  “Desmos  Calculator.”  https://www.desmos.com/calculator. 

Fox,  Kenneth  R.,  Bezalel  Gavish,  and  Stephen  C.  Graves.  1980.  “An  n- 

Constraint  Formulation  of  the  (Time  Dependent)  Traveling  Salesman 
Problem.”  Operations  Research  4:  1018-1021.  https://doi.org/10.1287/ 
opre.28.4.1018 

GAMS  Development  Corporation.  2013.  General  Algebraic  Modeling  System 
Software  Release  24.8.3,  Washington,  DC.  https://www.gams.com/. 

Golden,  Bruce  L.,  Larry  Levy,  and  Rakesh  Vohra.  1987.  “The  Orienteering 
Problem.”  Naval  Research  Logistics  34:  307-318. 

49 


Google  Earth  Pro.  2016.  Version  7.1.7.2606  (2016).  https://www.google.com/ 
earth/download/gep/agree.html. 

Hartman,  Travis  A.  2015.  “Rapid  Airlift  Planning  for  Amphibious-Ready  Groups.” 
Master’s  thesis,  Naval  Postgraduate  School. 

IBM.  2017.  IBM  ILOG  CPLEX  24.8.2  r59988  (released  January  3).  Version 
12.7.0.0.  https://  developer.ibm.com/academic/. 

Insitu.  n.d.  “ScanEagle.”  Retrieved  March  12,  2017.  https://  insitu.com/images/ 
uploads/pdfs/ScanEagle_SubFolder_Digital_PR08031 5.pdf. 

International  Maritime  Organization.  2002.  Consideration  and  adoption  of 

amendments  to  the  International  Convention  for  the  Safety  of  Life  at  Sea, 
1974.  SOLA  S/CON  F.  5/32.  Regulation  19.  12  December  2002. 
http  ://www.  u  n  .o  rg/en/sc/ctc/docs/bestpractices/32 .  pdf. 

Lawler,  Eugene  L.,  Jan  K.  Lenstra,  Alexander  H.G.  Rinnooy  Kan,  and  David  B. 
Shmoys.  1990.  The  Traveling  Salesman  Problem.  A  guided  Tour  of 
Combinatorial  Optimization.  Chichester:  John  Wiley  and  Sons. 

Lockheed  Martin,  n.d.  “MH-60R.”  Retrieved  March  12,  2017 

http://www.lockheedmartin.com/content/dam/lockheed/data/ms2/ 

documents/MH-60R-trifold.pdf. 

Nieto  Fernandez,  Jose  Luis.  2016.  “Retos  en  el  futuro  del  Arma  Aerea.”  Revista 
general  de  Marina  8:  319-332.  http://www.armada.mde.es/archivo/rgm/ 
201 6/08/201 6_08.pdf. 

Marine  Traffic,  n.d.  “Density  maps.”  Retrieved  March  12,  2017. 
https://www.marinetraffic.eom/en/p/density-maps. 

Python  Software  Foundation.  2017.  Version  2.7.13.  https://www.python.org/ 
downloads. 

R  Foundation  for  Statistical  Computing.  2016.  R  version  3.3.2.  https:// www.  r- 
project.org/about.html. 

Ship  Spotting,  n.d.  “Nexo  Maersk.”  Retrieved  March  17,  2017. 

http  ://www.shipspotting. com/gallery/photo. php?lid=1 25431 0. 

Sikorsky  Archives.  201 1 .  “Sikorsky  Product  History.”  Last  modified  June  20, 

201 2.  http://www.sikorskyarchives.com/S-70B%20(SH- 
60B%20Seahawk,%20SH-60F%20CV,%20HH- 

60H%20Rescue%20Hawk,%20HH-60J%20Jayhawk,%20VH-60N).php. 


50 


Sposato,  Joseph  J.  1995.  “Optimal  Routing  of  Ice  Reconnaissance  Aircraft.” 
Master’s  thesis,  Naval  Postgraduate  School. 

Stone,  Lawrence  D.,  Johannes  O.  Royset,  Alan  R.  Washburn.  2016.  Optimal 

Search  for  Moving  Targets,  International  Series  in  Operations  Research  & 
Management  Science.  Reston  and  Monterey,  CA.  doi:  10.1007/978-3-319- 
26899-6. 

Toth,  Paolo,  and  Paolo  Vigo.  2001 .  The  Vehicle  Routing  Problem.  Philadelphia, 
PA:  Society  for  Industrial  and  Applied  Mathematics  (Siam). 

Tsiligirides,  Theodore.  1984.  “Heuristics  Methods  Applied  to  Orienteering.”  The 
Journal  of  the  Operational  Research  Society.  Vol.  35,  No.  9:  797-809. 
http://www.inf.unibz.it/dis/teaching/SDB1314/papers/batch3a.pdf. 

Vansteenwegen,  Pieter,  Wouter  Souffriau,  and  Dirk  Van  Oudheusden.  2010. 

“The  Orienteering  Problem:  A  Survey.”  European  Journal  of  Operational 
Research  209  (2011):  1-10.  doi:1 0.1 01 6/j.ejor.201 0.03.045. 


51 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


52 


INITIAL  DISTRIBUTION  LIST 


1.  Defense  Technical  Information  Center 
Ft.  Belvoir,  Virginia 

2.  Dudley  Knox  Library 
Naval  Postgraduate  School 
Monterey,  California 


53 


